Biased Control-Variate Estimation

نویسندگان

  • Bruce W. Schmeiser
  • Michael R. Taaffe
چکیده

We study biased control variates (BCVs), whose purpose is to improve the efficiency of stochastic simulation experiments. BCVs replace the control-simulation mean with an approximation; the resulting control-variate estimator is biased. This bias may not be a significant issue for finite sample sizes, however, because our estimator minimizes the more general mean-squared-error (mse), i.e., the sum of the estimator variance plus the bias squared. After discussing an example, we review BCVs, including the mse optimal controlvariate weight and associated mse performance. We then consider the relationships among bias, induced correlation, relative mse reduction, computing effort and generalized mse (gmse), assuming the use of the mse-optimal control weight, both for cases with and without bias. We define and study two estimators for the optimal control-variate weight: the Natural Estimator and the Classical Estimator. The Classical Estimator, which simply ignores the bias, can yield substantial mse reduction when the error in the approximation is small compared to the sampling error of the control simulation.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Control-Variate Estimation Using Estimated Control Means

We study control variate estimation where the control mean itself is estimated. Control variate estimation in simulation experiments can significantly increase sampling efficiency, and has traditionally been restricted to cases where the control has a known mean. In a previous paper (Schmeiser, Taaffe, and Wang 2000), we generalized the idea of control variate estimation to the case where the c...

متن کامل

Multilevel Monte Carlo and control-variate simulation of Coulomb collisions

The multilevel Monte Carlo and the control-variate method are reviewed for simulation of Coulomb collisions. The test case considered is fast-ion relaxation from ion-ion and electron-ion collisions against a Maxwellian background. A simplified energy scattering model is derived and related to the Cox-Ingersoll-Ross model for which, an exact time dependent solution can be obtained. The exact mod...

متن کامل

New control variates for Lévy process models

We present a general control variate method for Monte Carlo estimation of the expectations of the functionals of Lévy processes. It is based on fast numerical inversion of the cumulative distribution functions and exploits the strong correlation between the increments of the original process and Brownian motion. In the suggested control variate framework, a similar functional of Brownian motion...

متن کامل

Sample-efficient Policy Optimization with Stein Control Variate

Policy gradient methods have achieved remarkable successes in solving challenging reinforcement learning problems. However, it still often suffers from the large variance issue on policy gradient estimation, which leads to poor sample efficiency during training. In this work, we propose a control variate method to effectively reduce variance for policy gradient methods. Motivated by the Stein’s...

متن کامل

Application of the control variate technique to estimation of total sensitivity indices

Global sensitivity analysis is widely used in many areas of science, biology, sociology and policy planning. The variance-based methods also known as Sobol' sensitivity indices has become the method of choice among practitioners due to its efficiency and ease of interpretation. For complex practical problems, estimation of Sobol' sensitivity indices generally requires a large number of function...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2000